Iteratively Reweighted Least Squares for Maximum Likelihood Estimation, and some Robust and Resistant Alternatives
نویسنده
چکیده
The scope of application of iteratively reweighted least squares to statistical estimation problems is considerably wider than is generally appreciated. It extends beyond the exponential-family-type generalized linear models to other distributions, to non-linear parameterizations, and to dependent observations. Various criteria for estimation other than maximum likelihood, including resistant alternatives, may be used. The algorithms are generally numerically stable, easily programmed without he aid of packages, and highly suited to interactive computation.
منابع مشابه
The iteratively reweighted estimating equation in minimum distance problems
The class of density based minimum distance estimators provide attractive alternatives to the maximum likelihood estimator because several members of this class have nice robustness properties while being rst order eÆcient under the assumed model. A helpful computational technique { similar to the iteratively reweighted least squares used in robust regression { is introduced which makes these e...
متن کاملIteratively reweighted LASSO for mapping multiple quantitative trait loci
The iteratively reweighted least square (IRLS) method is mostly identical to maximum likelihood (ML) method in terms of parameter estimation and power of quantitative trait locus (QTL) detection. But the IRLS is greatly superior to ML in terms of computing speed and the robustness of parameter estimation. In conjunction with the priors of parameters, ML can analyze multiple QTL model based on B...
متن کاملMaximum Likelihood for Generalized Linear Model and Generalized Estimating Equations
The most frequent methods to analyze statistical data are the regression methods, whereby the maximum likelihood method or that of least squares. On the one hand, in the context of the longitudinal data or repeated measurements, these data are often unbalanced; on the other hand, their law of probability are not normal rending the passage to other models with other methods of estimate possible....
متن کامل[Proceeding] Fast and Robust EM-Based IRLS Algorithm for Sparse Signal Recovery from Noisy Measurements
In this paper, we analyze a new class of iterative re-weighted least squares (IRLS) algorithms and their effectiveness in signal recovery from incomplete and inaccurate linear measurements. These methods can be interpreted as the constrained maximum likelihood estimation under a two-state Gaussian scale mixture assumption on the signal. We show that this class of algorithms, which performs exac...
متن کاملOn maximum likelihood fuzzy neural networks
In this paper, M-estimators, where M stands for maximum likelihood, used in robust regression theory for linear parametric regression problems will be generalized to nonparametric maximum likelihood fuzzy neural networks (MFNNs) for nonlinear regression problems. Emphasis is put particularly on the robustness against outliers. This provides alternative learning machines when faced with general ...
متن کامل